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THREE-DIMENSIONAL IMAGE CAPTURING DEVICE 



BACKGROUND OF THE INVENTION 

1, Field of the Invention 

The present invention relates to a three-dimensional 

image capturing device by which a three-dimensional shape of 

a measurement subject, which is to be measured, is captured by 
a time-of -flight measurement. 

2. Description of the Related Art 

A three-dimensional measurement using a 

three-dimensional image capturing device is classified as an 
active system, in which light, an electric wave or sound is 
radiated onto a measurement subject, and a passive system in 

which the light , electric wave or sound is not output . The active 

system comprises the time-of-f light measurement, a phase 
detection using a modulated light wave, a triangulation , a moire 

topography, and so on, and the passive system comprises a stereo 
vision system, and so on. 

An active system device is bulky in comparison with that 
of the passive system, since the device requires a laser beam 
output mechanism. However, the active system device is superior 
regarding a distance measurement resolution, a measuring time, 
a measuring range and so on, and thus, despite the bulkiness , 
the device is utilized in various fields . In a three-dimensional 
image capturing device, described in "Measurement Science and 



Technology" (S. Christie et al w vol . 6 , p. 1301-1308, 1995), a 
pulse-modulated laser beam irradiates a measurement subject, 
and a reflected light beam, which is reflected by the measurement 
subject, is received by a two-dimensional CCD sensor to which 
an image intensifier is attached, so that an image signal, 
corresponding to the reflected light beam, is converted to an 
electric signal. ON-OFF control of the image intensifier is 
carried out by a gate pulse, which is synchronized with the pulse 
radiation of the laser beam. According to the device, since 
an amount of received light, based on the reflected light beam 
from the measurement subject, which is positioned far from the 
device, is less than that of received light based on a reflected 
light beam from a measurement subject, which is close to the 
measurement subject, an output corresponding to a distance 
between the measurement subject and the device can be obtained 
for each pixel of the CCD . 

In a device disclosed in International Publication No. 
WO 97/01111, light, such as a laser beam, which is pulse-modulated, 
irradiates a measurement subject, and a reflected light beam, 
which is reflected by the measurement subject, is received by 
a two-dimensional CCD sensor which is assembled with a mechanical 
shutter or an electro-optical shutter formed by a liquid crystal 
display, so that an image signal corresponding to the reflected 
light beam is converted to an electric signal. The shutter is 
controlled at a timing which is different from that of the laser 



beam, so that distance information of the measurement subject 
is obtained for each pixel of the CCD. 

In the conventional three-dimensional image capturing 
device of an active system described above , an optical shutter, 
5 such as a KDP element, is provided so that an electric charge 
accumulating operation in the CCD sensor is controlled . However , 
not only is the optical shutter bulky , but also an electric circuit, 
which outputs a high voltage to drive the optical shutter, should 
be provided, and thus the conventional device becomes and remains 
10 bulky. 

On the other hand, in USP No. 5,081,530, a device, in 

which an electronic shutter is provided for controlling an 

electric charge accumulating operation of a CCD sensor, is 
disclosed. However, an output of the CCD sensor, which is 
15 obtained by a single operation of the electronic shutter, is 
not great enough to sense distance information of the measurement 
subject . 

SUMMARY OF THE INVENTION 

Therefore, an object of the present invention is to 

20 provide, at a moderate price, a miniaturized three-dimensional 
image capturing device , which operates without an optical shutter, 
and by which an output sufficient to acquire three-dimensional 
distance information of the measurement subject is obtainable 
even when a high definition CCD is used so as to detect a high 

25 definition image of the subject. 
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Further another object of the present invention is to 
provide a three-dimensional image capturing device by which 
three-dimensional distance information of the high speed moving 
subject is detectable. 
5 According to the present invention, there is provided 

a three-dimensional image capturing device, comprising a light 
source, a plurality of firs t and second photoelectric conversion 
elements, a first and a second electric charge holding units, 
a first and a second electric charge transfer processors and 

10 an electric charge integrating processor. 

The light source radiates a distance measuring light beam 
irradiating a measurement subject. The measurement subject 
reflects the distance measuring light beam to generate a reflected 
light beam. The first and second photoelectric conversion 

15 elements receive the reflected light beam, so that electric charge 
corresponding to an amount of the received reflected light beam 
is accumulated in each of the photoelectric conversion elements . 
The first and second electric charge holding units are disposed 
adjacent to each of the first and second photoelectric conversion 

20 elements, respectively. The first and second electric charge 

transfer processors transfer the electric charge accumulated 
in each of the first and second photoelectric conversion elements 
to each of the first and second electric charge holding units 
with first and second electrodes connected only to each of the 
25 first and second electric charge holding units respectively. 



4 



The electric charge integrating processor drives the first 
electric charge transfer processor repeatedly, so that electric 
charge accumulated in the first photoelectric conversion 
elements is integrated in the first electric charge holding unit. 

Preferably, the device further comprises a first and 
second electric charge discharging processor. The first and 
second electric charges discharging processor discharges 
unwanted charge accumulated in each of the first and second 

photoelectric conversion elements, so that an accumulating 
operation of electric charge are started in each of the first 
and second photoelectric conversion elements . And the electric 
charge integrating processor is operated by driving the first 
electric charge discharging processor and the first electric 
charge transfer processor alternately. 

Further, according to the present invention, there is 
provided a three-dimensional image capturing device , comprising 
a light source, a plurality of optical sensors, electric charge 
transfer electrodes, an electric charge transfer unit, an 
electric charge transfer electrode control processor and an 
electric charge accumulating processor. 

The light source radiates a distance measuring light beam 
irradiating a measurement subject. The measurement subject 
reflects the distance measuring light beam to generate a reflected 
light beam. The optical sensors receive the reflected light 
beam, so that electric charge corresponding to an amount of the 



received reflected light beam is generated in each of the optical 
sensors . 

The plurality of optical sensors generates electric 
charge corresponding to an amount of light received by the optical 
sensors and is separated into predetermined groups . The electric 

charge transfer electrodes are applied to each of the optical 

sensors in order to transfer the electric charge generated in 
the optical sensors to the outside of the optical sensors. The 
electric charge transfer unit holds the electric charge 
transferred from the optical sensors by the electric charge 
transfer electrodes and transports the electric charge held in 
the electric charge transfer unit. The electric charge transfer 

electrode control processor controls each group of the electric 

charge transfer electrodes independently. The generated 
electric charge accumulating processor repeatedly drives the 
electric charge transfer electrode control processor and 
transfers electric charge generated in certain groups of the 
optical sensors , so that transferred electric charge accumulates 
in the electric charge transfer unit. 

According to another aspect of the present invention, 
there is provide a three-dimensional image capturing device 
comprising a light source, a plurality of photoelectric 
conversion elements, a vertical transfer unit, a horizontal 
transfer unit, an electric charge transfer processor , an electric 
charge integrating processor and a transfer operation control 



processor . 

The light source radiates a distance measuring light beam 
irradiating a measurement subject, SO that the measurement 
subject reflects the distance measuring light beam to generate 
5 a reflected light beam. The plurality of photoelectric 
conversion elements is disposed in a matrix arrangement and 
receives the reflected light beam, so that electric charge 
corresponding to an amount of the received reflected light beam 

Q is accumulated in each of the photoelectric conversion elements . 

; ?\ 

!i| 10 The vertical transfer unit is disposed along each vertical line 

p of the photoelectric conversion elements, so that the electric 

4S charge accumulated in the photoelectric conversion elements is 

O transferred in a vertical direction. The horizontal transfer 

! «f unit is disposed nearby one end of the vertical transfer unit 

2 15 and in parallel with horizontal lines of the photoelectric 

conversion elements, so that the electric charge is transferred 
in a horizontal direction . The electric charge transfer processor 
can transfer electric charge accumulated only in photoelectric 
conversion elements that comprises in effective horizontal lines , 
20 which are disposed every predetermined number of lines in the 
horizontal lines . The electric charge integrating processor 
drives the electric charge transfer processor repeatedly and 
integrates the electric charge accumulated in the photoelectric 
conversion elements comprising the effective horizontal lines 
25 in the vertical transfer unit. The transfer operation control 

7 



processor controls the horizontal transfer unit and the vertical 
transfer unit, so that the horizontal transfer unit is driven 
only when the electric charge corresponding to the effective 
horizontal lines is transferred to the horizontal transfer unit. 
5 Further, according to the present invention, there is 

provided a three-dimensional image capturing device comprising 
a light source , a plurality of photoelectric conversion elements , 
an electric charge transfer control processor, 3l distance 
calculating processor and a first and second distance measuring 
10 processor. 

The light source radiates light irradiating a measurement 
subject. The plurality of photoelectric conversion elements 
is disposed in a matrix arrangement and can accumulate electric 
charge corresponding to an amount of light received by the 

15 photoelectric conversion elements . The electric charge 
transfer control processor controls an electric transfer 
operation, which outputs electric charge accumulated in the 
photoelectric conversion elements to the outside of the 
photoelectric conversion elements. The distance calculating 

20 processor calculates a distance, from the photoelectric 
conversion element to the measurement subject, from an amount 
of electric charge accumulated in the photoelectric conversion 
elements, from light reflected by the measurement subject and 
received in the photoelectric conversion elements. The first 

25 distance measuring processor drives the electric charge 
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transfer control processor in order to output electric charge 
accumulated in all tlie photoelectric conversion elements , and 
calculates distances corresponding to all the photoelectric 
conversion elements by means of the distance calculating 
5 processor . The second distance measuring processor drives the 
electric charge transfer control processor in order to output 
electric charge accumulated in certain partial photoelectric 
conversion elements, and calculates distances corresponding to 
the partial photoelectric conversion elements by means of the 

10 distance calculating processor. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The objects and advantages of the present invention will 
be better understood from the following description r with 
reference to the accompanying drawings in which: 

15 Fig. 1 is a perspective view showing a camera provided with a 

three-dimensional image capturing device of a first embodiment 

of the present invention; 

Fig. 2 is a block diagram showing an electrical construction 
of the camera shown in Fig . 1 ; 

20 Fig. 3 is a view showing a principle behind a distance measurement ; 
Fig. 4 is a timing chart showing a distance measurement light 
beam, a reflected light beam, a gate pulse and a distribution 
of an amount of a light beam received by a CCD; 
Fig. 5 is a plan view showing a disposition of photo-diodes and 

25 a vertical transfer unit, which are provided in the CCD of the 
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first embodiment; 

Fig. 6 is a sectioned elevational view of the CCD; 

Fig. 7 is a timing chart of a distance information sensing 

operation by which data , corresponding to a distance from a camera 

5 body to each point on a surface of the measurement subject , is 
sensed; 

Fig. 8 is a timing chart of a distance correction information 
sensing operation; 

Fig. 9 is a timing chart of a reflectance information sensing 
10 operation; 

Fig. 10 is a timing chart of a reflectance correction information 
sensing operation ; 

Figs. 11A and 11B show a flowchart of the distance information 
sensing operation of the first embodiment; 
15 Fig. 12 is a diagram of an equivalent circuit of the vertical 
transfer electrodes in the CCD; 

Fig. 13 shows a pulse signal input to the equivalent circuit 
shown in Fig. 12 and a signal output therefrom; 

Fig. 14 is a timing chart of a distance information sensing 
20 operation regarding the time constant in the equivalent circuit 
of the vertical transfer electrodes ; 

Fig. 15 is a perspective view showing a camera provided with 
a three-dimensional image capturing device of a second embodiment 
of the present invention; 
25 Fig, 16 is a plan view showing a disposition of photo-diodes 
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and a vertical transfer unit, which are provided in the CCD of 
the second embodiment. 

Figs. 17A, 17B and 17C show a flowchart o£ the distance information 
sensing operation of the second embodiment; 
5 Fig. 18 is a plan view showing a disposition of photo-diodes, 
a vertical transfer unit and a horizontal transfer unit; 
Figs. 19A, 19B and 19C are timing charts of vertical transfer 
CCD pulse and horizontal transfer CCD pulse in the Dn mode, Dhl 

mode and Dh2 mode, respectively; 
10 Fig. 20 is a timing chart of a distance measurement operation 

executed in Dn mode, Dhl made and Dh2 mode, respectively. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention is described below with reference 
to embodiments shown in the drawings . 

15 Fig. 1 is an external view of an optical reader of a first 

embodiment of the present invention . 

On a front surface of a camera body 10, a view-finder 
window 12 is provided toward a left-upper edge, adjacent to a 
photographing lens 11, and an electronic flash 13 is disposed 

20 toward a right-upper edge . On an upper surface of the camera 
body 10, a light emitting device (i.e. , a light source) 14, which 
radiates a laser beam (an infrared laser beam, for example, being 
a distance measuring light beam) is mounted above the 
photographing lens 11 . A release switch 15 and a liquid crystal 

25 display panel 16 are provided on a left side of the light emitting 
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device 14, and a mode change dial 17 and a V/D mode switch 18 
are provided on a right side of the device 14 . On a side surface 
of the camera body 10, a card slot 19 is formed, into which a 
recording medium, such as an IC memory card, is in ser table , and 
a video output terminal 2 0 and an interface connector 21 are 

also provided. 

Fig. 2 is a block diagram showing an electrical 
construction of the camera of Fig, 1. 

An aperture 25 is provided in the photographing lens 11. The 
opening degree of the aperture 25 is adjusted by an iris drive 
circuit 26. A focusing operation and a zoom operation of the 
photographing lens 11 are controlled by a lens drive circuit 
27 . 

An imaging device (CCD) 2 8 is disposed on an optical axis 
of the photographing lens 11 . A subject image is formed on a 
light receiving surface of the CCD 28 through the photographing 
lens 11, and an electric charge corresponding to the subject 
image is generated therein. An operation, such as an 
accumulating operation and a reading operation of the electric 
charge of the CCD 28, is controlled by a CCD drive circuit 30. 
An electric charge signal, i.e. , an image signal, read from the 
CCD 28 is amplified by an amplifier 31, and is converted from 
an analog signal to a digital signal by an A/D converter 32 . 
The digital image signal is subjected to a process, such as a 
gamma correction, in the image signal process circuit 33, and 
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is stored as digital image data in an image memory 34 . The iris 
drive circuit 26, the lens drive circuit 27 , the CCD drive circuit 

30 and the image signal process circuit 33 are controlled by 

a system control circuit 35 . 

5 The digital image data are read from the image memory 

34, and supplied to an LCD drive circuit 36, which is operated 
in accordance with the digital image data, so that an image 

corresponding to the digital image data is indicated on an image 
indication LCD panel 37 . 
10 The digital image data read from the image memory 34 are 

also transmitted to a TV signal encoder 38, so that the digital 
image data can be transmitted to a peripheral monitor device 

39, provided externally to the camera body 10, through a video 
output terminal 20. The system control circuit 35 is connected 

15 to an interface circuit 40, which in turn is connected to an 
interface connector 21. Therefore , the digital image data read 
from the image memory 34 , can also be transmitted to a computer 
41 connected to the interface connector 21 . Further, the system 
control circuit 35 is connected to an image recording device 

20 43 through a recording medium control circuit 42. Therefore, 
the digital image data read from the image memory 34 can be recorded 
in a recording medium M, such as an IC memory card, mounted in 
the image recording device 43. 

A light emitting element control circuit 44 is connected 

25 to the system control circuit 35 . The light emitting device 
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14 is provided with a light emitting element 14a and an 
illumination lens 14b , and an operation o£ the light emitting 
element 14a is controlled by the light emitting element control 
circuit 44. The light emitting element 14a radiates a laser 
beam, which is a distance measuring light beam, and which 
irradiates a whole of a measurement subject through the 
illumination lens 14b. The laser beam, reflected by the 
measurement subject, becomes incident on the photographing lens 
11. By detecting the laser beam with the CCD 28 provided with 
a plurality of photo-diodes, which are two-dimensionally 
disposed on a surface thereof, a three-dimensional image is sensed, 
as described later. 

The liquid crystal display panel 16 and a switch group 

45, including the release switch 15, the mode change dial 17 
and the V/D mode switch 18, are connected to the system control 
circuit 35. 

With reference to Figs . 3 and 4 , a principle behind 
a distance measurement in the embodiment is described below. 
Note, in Fig. 4, the abscissa indicates time "t" . 

A distance measuring light beam output by a distance 

measurement device B is reflected by a measurement subject S, 
and the reflected light beam is s^ns&d by a CCD (not shown) . 
The distance measuring light beam is a pulse, the width of which 
is U H". Accordingly, the reflected light beam is a pulse, the 
width of which is "H" , similarly to the distance measuring light 
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beam. Therefore, a rise of the pulse of the reflected light 
beam occurs after a rise of the pulse of the distance measuring 
light beam by a time 5* t (5 is a delay coefficient) . Since the 
distance measuring light beam and the reflected light beam have 
both traveled a distance "r" between the distance measurement 

device B and the measured subject S, the distance "r" is 

represented as follows : 

r = 5- t-C/2 ... (1) 

wherein "C" is the speed of light. 

For example, by setting a condition in such a manner that 
the reflected light beam can only be sensed from a rise of the 
pulse of the distance measuring light beam to a point prior to 

a fall of the pulse of the reflected light beam , i . e . , by providing 
a gate pulse corresponding to a reflected light beam detecting 
period T, an amount "A" of received light from the reflected 
light beam becomes a function of the distance "r" . Namely, the 

greater the distance "r" (or the greater the time 5t) , the less 

the received light amount A. 

In the embodiment, by taking advantage of the principle 
described above, the received light amount A is sensed using 
each of the photo-diodes (photoelectric conversion elements) 
of the CCD 28, the distance from the camera body 10 to each point 
on the surface of the measurement subject S is sensed, and data 
of the three-dimensional image, which indicates a topography 
of the measurement subject S, can be obtained concurrently. 

15 



Fig. 5 is a plan view showing a disposition of the 
photo-diodes 51a x , 51a 2 (first and second photoelectric 
conversion elements) and a vertical transfer unit 52 , which are 
provided in the CCD 28. Actually, a multitude of photo-diodes 
5 51ai and 51a2 are arranged in a matrix, and a corresponding 
vertical transfer unit 52 is disposed beside each vertical 
column of photo-diodes 51ai and 51a 2 - Fig. 6 is a sectioned 
elevational view of the CCD 28 in which the CCD 2 8 is cut by 
=j a plane perpendicular to a substrate 53. The CCD 28 is an 

fj 10 interline CCD of vertical overflow drain (VOD) type, in which 
0 unwanted charge is discharged to the substrate 53 . 

y The photo-diodes 51ai, 51a 2 and the vertical transfer 

«l unit (electric charge holding unit) 52 are formed along a surface 

fi 

3 of the n-type substrate 53. As shown in Fig. 5, in the vertical 

0 

3 15 direction of the CCD 28, the photo-diodes 51ai are arranged with 

three photo-diodes 51a 2 in between each of the photo-diodes 51ai, 
that is, the photo-diodes 51ai are disposed every fourth 
horizontal line of the CCD 28. The vertical transfer unit 52 
is disposed adjacent to the each of photo-diodes 51ai and 51a 2 , 
20 parallel to rows extending in a vertical direction in Fig. 5 
and is provided with a plurality of first and second electric 

charge holding units . Each of the first electric charge holding 
units comprises four vertical transfer electrodes 52ai, 52bi, 
52ci and 52di, which correspond to each of the photo-diodes 51ai. 
25 Similarly, each of the second electric charge holding units 
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comprises four vertical transfer electrodes 52a 2 , 52b 2 , 52c 2 and 
52d 2 f which correspond to each of the photo-diodes 51a 2 . The 
vertical transfer electrodes that are indicated with same 
reference sign are mutually connected and the electric potential 
5 of those vertical transfer electrodes are kept the same. For 
example, all of the vertical transfer electrodes 52a 2 are 
connected together and every electrode 52 a 2 have the same electric 
potential. Further, the vertical transfer electrodes 52bi and 
Q 52b 2 are connected together. Similarly, groups of the vertical 

^ 10 transfer electrodes 52c!, 52c 2 and of the vertical transfer 

=5 electrodes 52di, 52d 2 are also mutually connected in each group. 

= g Namely, the vertical transfer electrodes provided in the 

□ vertical transfer units 52 of CCD 28 are classified into five 

*3 groups of electrodes, that is, the group comprised of the 

;"sj 

^ 15 electrodes 52ai, the group comprised of the electrodes 52a 2 , the 

group comprised of the electrodes 52bi , 52b 2 , the group comprised 
of the electrodes 52ci, 52c 2 and the group comprised of the 
electrodes 52d X/ 52d 2 . For each group of electrode, voltage 
signals can be applied independently. Namely, for example, 

20 voltage signal can be applied only to the electrodes indicated 
with the reference sign 52ai or the reference signs 52bi and 
52b 2 , and not to the other electrodes . Therefore , in the vertical 
transfer unit 52, four potential wells can be formed, so that 
a signal charge is output from the CCD 2 8 by controlling a depth 

25 of the wells , as is well known . Note that a number of the vertical 



transfer electrodes can be changed , depending upon the 
requirement of the CCD 28. 

The photo-diodes (PD) 51ai, 51a 2 and the vertical transfer 

unit (V-CCD being electric charge holding unit) 52 are disposed 

5 in a p-type well formed on a surface of the substrate 53, The 

p-type well is completely depleted due to an inverse bias voltage 
applied between the p-type well and the n-type substrate 53. 

In this state , electric charge is accumulated in the photo-diodes 
51ai, 51a 2/ and an amount of the electric charge corresponds to 

10 an amount of an incident light beam, which is the reflected light 
beam reflected by the measurement subject. When a substrate 
voltage is changed to a value greater than a predetermined value, 
electric charge accumulated in the photo-diodes 51ai, 51a 2 is 
discharged to the substrate 53. Conversely, when an electric 

15 charge transfer signal, which is a voltage signal, is applied 
to a transfer gate (TG) 54, the electric charge accumulated in 
the photo-diodes 51ai, 51a 2 is transferred to the vertical 
transfer unit 52. Namely, after the electric charge is 
discharged to the substrate 53 by the electric charge discharging 

20 signal, the signal charge accumulated in the photo-diodes 51ai, 
51a 2 is transferred to the vertical transfer unit 52 by the 
electric charge transfer signal. By repeating the discharge 
and the transfer, an electronic shuttering operation is 
performed. 

25 The CCD, in the present embodiment, is provided with the 
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photo-diodes Slai comprising the vertical transfer electrodes 

52ai and photo-diodes 51a 2 comprising the vertical transfer 
electrodes 52a 2 . However, only photo-diodes 51ai are used for 
detecting data that relates to the distance . As described later , 

5 fcne reason wky only photo-diodes 51a! are used for sensing the 

data relating to the distance is due to the difficulty that 
occurs during the distance information sensing operation when 
the number of pixels (the number of photo-diodes) is increased 
as to obtain a high definition image. On the other hand, the 

10 image information sensing operation , which detects data relating 

to an image of the measuring subject, applies both the 
photo-diodes 51a x and 51a 2 in the operation. 

Fig. 7 is a timing chart of a distance information sensing 
operation by which data, corresponding to the distance from the 

15 camera body 10 to each point on a surface of the measurement 
subject , is sensed. The distance information sensing operation 
is described below with reference to Figs. 1, 2, 5, 6 and 7. 
Note that the timing chart of the distance information sensing 
operation in the present embodiment is slightly different from 

20 the timing chart of the distance measurement principle, which 
was described above with reference to Fig . 4 . Namely, the timing 
chart of the present embodiment is set so as to sense the reflected 
light beam from a point subsequent to the rise of the reflected 
light beam pulse to a point subsequent to the fall. By this 

25 manner, a noise component due to an ambient daylight may be reduced, 
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though the principles of the above distance measurement means 
are basically the same. 

In synchronization with an output of a vertical 
synchronizing signal (not shown) , an electric charge discharging 
5 signal (a pulse signal) SI is output, so that unwanted charge, 
which is accumulated in the photo— diodes 51ai, is discharged 
to the substrate 53. The electric charge value, while the pulse 
signal SI is output, is indicated as S2 in the chart. After 
the electric charge discharging signal SI is output, the light 

10 emitting device 14 is actuated, and thus a distance measuring 

light beam S3, which is a pulsed beam having a constant width 
T g , is output therefrom. A period for outputting the distance 

measuring light beam S3 or the width o£ the pulse beam is modulated 
according to a requirement . In the present embodiment, the 

15 distance measuring light beam S3 is modulated as to be completed 
approximately simultaneously with a completion of the output 
of the electric charge discharging signal SI . 

The distance measuring light beam S3 is reflected by the 
measurement subject, and enters the CCD 28 as a reflected light 

20 beam S4 . When the output of the electric charge discharging 
signal SI ends, the electric charge for incident light, which 
comprises the reflected light beam S4 and an ambient daylight, 
starts on each of the photo-diodes and a signal charge S5 is 
sensed. When an incident of the reflected light beam S4 is 

25 completed, i.e. after the fall indicated with a reference sign 
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S6 , the photo-diodes only generate signal charge S8 due to the 

ambient daylight. 

An electric charge transfer signal (pulse signal) S 9 is 
output only to the vertical transfer electrodes 52a!, and an 
5 electric charge accumulated in the photo-diodes 51ai are 
transferred to the vertical transfer unit 52 . The operation 

of transferring the accumulated electric charge in the 

photo-diodes 51ai ends with the fall S10, which is a termination 
of the output of the electric charge transfer signal S9 . Namely, 
10 a signal charge Sll of which electric signal accumulation was 
started just after the completion of the electric charge 

discharging signal output and terminated just after the 
completion of the output of the electric transfer signal S9, 
is transferred to the vertical transfer unit 52, while the 

15 photo-diodes continue to accumulate electric signals S14 due 
to the ambient daylight. 

Thus during a period Tui from the end of the output of 
the electric charge discharging signal SI to the end of the output 
of the electric charge transfer signal S9, a signal charge Sll, 

20 corresponding to distances from the camera body 10 to the 
measurement subject and the ambient daylight is accumulated in 
the photo-diodes 51ai. Namely, the signal charge S12, a hatched 
portion of signal charge Sll, corresponds to the distances from 

the camera body 10 to the measurement subject, while a residual 
25 portion S13 of the signal charge Sll results from the ambient 
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daylight . 

When a predetermined time has elapsed since the output 

of the electric charge transfer signal S9 , a subsequent electric 
charge discharge signal is output, so that the signal charge 
S14, an electric charge accumulated in the photo-diodes after 
the signal charge transfer to the vertical transfer unit 52, 
is discharged to the substrate 53 . Subsequently, another signal 
charge is accumulated in the photo-diodes 51a x . Then, similarly 
to the above description, when the electric charge accumulation 
period T al has again elapsed, the signal charge Sll is transferred 
to the vertical transfer unit 52 . 

The transferring operation of the signal charge Sll to 
the vertical transfer unit 52 is repeatedly performed until the 
next vertical synchronizing signal (not shown) is output. Thus, 
the signal charge Sll is integrated in the vertical transfer 

unit 52 . The signal charge Sll integrated for one field period, 

which is between two vertical synchronizing signals , corresponds 
to distance information of the measurement subject, on condition 
that the measurement subject ±s stationary for the period, between 
the two vertical synchronizing signals . 

The detecting operation of the signal charge Sll described 
above is carried out in all of the photo-diodes 51ai provided 
in the CCD 28. As a result of the detecting operation for one 
f ieldperiod, the distance information sensedby the photo-diodes 
51ai is held in each corresponding vertical transfer unit 52ai, 
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which is located adjacent to each column of photo-diodes 51ai. 
The distance information is output from the CCD 28 by a vertical 
transferring operation of the vertical transfer units 52 and 
a horizontal transferring operation of a horizontal transfer 

5 unit (not shown) . The distance information is then output from 

the CCD 28, as a three-dimensional image data of the measured 
subject . 

The reflected light beam detectedby the CCD 28 is affected 

by the reflectance of the surface of the subject. Therefore, 
10 the distance information obtained through the reflected light 
beam contains error derived from the reflectance. Further, the 

light beam sensed by the CCD 28 may contain an extra component, 
such as ambient daylight, being other than the reflected light 
beam from the measurement subject, which can cause an error. 

15 With reference to Fig. 1, Fig. 2, Fig. 7 to Fig. 11B, 

methods of correcting such errors are explained as a part of 
the distance information sensing operation, performed in the 
present embodiment. Fig. 8, Fig. 9 and Fig. 10 are timing charts 
of a distance correction information sensing operation , a 

20 reflectance information sensing operation and a reflectance 
correction information sensing operation, respectively. 
Fig. 11A and Fig. 11B are a flowchart of the distance information 
sensing operation . 

When it is recognized in Step 101 that the release switch 

25 15 is fully depressed f Step 102 is executed in which it is 



determined which mode is selected, a video (V) mode or a distance 

measurement (D) mode. A change between the modes is carried 
out by manually operating the V/D mode switch 18. 

When the D mode is selected, Step 103 is executed in which 
5 the vertical synchronizing signal is output and a distance 

measuring light beam control is started. Namely, the light 
emitting device 14 is driven so that the distance measuring light 
beam S3 is intermittently output as a pulsed beam. Then, Step 
^ 104 is executed so that a sensing operation control of the CCD 

m 10 28 is started. Namely, the distance information sensing 

m 

; *y operation described with reference to Fig. 7 is started, and 

^Jj thus the electric charge discharging signal SI and the electric 

~ charge transfer signal S9 are alternately output, so that the 

^ signal charge Sll of the distance information is integrated in 

q 15 the vertical transfer unit 52 . 

In Step 105, it is determined whether one field period 

has elapsed, since the beginning of the distance information 
sensing operation, i.e., whether a new vertical synchronizing 
signal has been output. When one field period has passed, the 

20 process goes to Step 106 in which the signal charge Sll of the 
distance information is output from the CCD 28 . The signal charge 
Sll is then temporally stored in the image memory 34 in Step 
107. Then, in Step 108, the distance measuring light beam control 
is turned OFF, and thus the light emitting operation of the light 

25 emitting device 14 is terminated. 
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In Steps 109 through 112, the distance correction 

information sensing operation is performed. In Step 109, a 
vertical synchronizing signal is output, and. a sensing operation 
control of the CCD 28 is started. Namely, as shown in Fig. 8, 
5 an electric charge discharging signal S21 and an electric charge 

transfer signal 222 are alternately output while the light 

emitting operation of the light emitting device 14 is not carried 
out, i.e. , while the light source is not illuminated. Although 
the electric charge accumulation period Tui is the same as that 

10 of the distance information sensing operation shown in Pig. 7, 

the distance measuring light beam does not irradiate the 
measurement subject (reference S23) , and thus there is no 
reflected light beam (reference S24) . Therefore, although a 
signal charge of the distance information is not generated, a 

15 signal charge S25 corresponding to an interference or noise 
component is generated, since the noise component, such as ambient 
daylight, enters the CCD 28. When an electric charge transfer 
signal S22 is output, a signal charge S26, a charge accumulated 
during the electric charge accumulation period T ui , is transferred 

20 to the vertical transfer unit 52. The signal charge S26 
corresponds to distance correction information, which is used 
for correcting an error generated in the distance information 
due to the noise component, and is related to the electric charge 
accumulation period Tui . 

25 In Step 110, it is determined whether one field period 



lias elapsed since the beginning of the distance correction 
information sensing operation, i.e., whether a new vertical 

synchronizing signal has been output. When one field period 

has passed, the process goes to Step 111 in which the signal 
5 charge S2 6 of the distance correction information is output from 
the CCD 28. The signal charge S26 is then temporarily stored 

in the image memory 34 in Step 112. 

In Steps 113 through 117, the reflectance information 
sensing operation is performed. In Step 113, a vertical 
;|1 10 synchronizing signal is output, and a distance measuring light 

i e rs 

beam control of the CCD 2 8 is started. Namely, as shown in Fig. 9, 
L y a distance measuring light beam S33 is intermittently output 

as a pulsed beam. In Step 114, a sensing operation control of 
q the CCD 28 is started, and thus an electric charge discharging 

Q 15 signal S31 and an electric charge transfer signal S3 5 are 

alternately output. The electric charge of photo-diodes is 

discharged (reference S32) as the electric charge discharge 
signal S31 is output. After completion of an output of the 
electric charge discharge signal S31, a distance measurement 

20 light beam S33 is emitted from the light emitting device 14, 
and a reflected light beam S34 is made incident on the CCD 28. 
An electric charge transfer signal S35 is output after a period 
sufficient to detect all of the reflected light beam S34 . 
Namely , the reflectance information sensing operation is 

25 controlled in such a manner that all of the reflected light beam 
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S34 is received with. in an electric charge accumulation period. 
Tu2/ which is from an end of an output of the electric charge 

discharging signal S31 to an end of an output of the electric 

charge transfer signal S35. Note that, a width T s of the signal 
5 charge S33 accumulated in each of the photo-diodes 51ai of the 
CCD 28 is the same as a width T s of the distance measuring light 
beam S33. 

During a period in which all of the reflected light beam 

534 is sensed, a signal charge S36 accumulated in the photo-diodes 
10 51ai is due to the reflected light beam S34 and the ambient daylight . 

The signal charges S37 and S38 are charges generated only by 
the ambient daylight. When the electric charge transfer signal 

535 is output, the signal charge 339 is transferred to the vertical 
transfer unit 52 . 

15 Therefore, the signal charge, which is detected during 

the electric charge accumulation period T u2 , including the signal 
charge S ' 3 9 generated by the ambient daylight, does not depend 
upon the distance of the measurement subject, and corresponds 
to the reflectance information which depends on the reflectance 

20 of the surface of the measurement subject. 

In Step 115, it is determined whether one field period 
has elapsed since the beginning of the reflectance information 
sensing operation, i.e., whether a new vertical synchronizing 

signal has been output . When one field period has passed, the 

25 process goes to Step 116 in which the signal charge S39 of the 
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reflectance information is output from the CCD 28. The signal 
charge S3 9 is then temporarily stored in the image memory 34 
in Step 117. Then, in Step 118, the distance measuring light 
beam control is turned OFF, and thus the light emitting operation 

5 of the light emitting device 14 is terminated. 

In Steps 119 through 122, the reflectance correction 
information sensing operation is performed. In Step 119, a 
vertical synchronizing signal is output, and a sensing operation 

control of the CCD 28 is started. Namely, as shown in Fig. 10, 
10 an electric charge discharging signal S41 and an electric charge 
transfer signal S42 are alternately output while the light 

emitting operation of the light emitting device 14 is not carried 
out. Although the electric charge accumulation period T u2 is 
the same as that of the reflectance information sensing operation 

15 shown in Fig. 9, the distance measuring light beam does not 
irradiate the measurement sub ject (reference S43) , and thus there 
is no reflected light beam (reference S44) . Therefore, although 
a signal charge of the reflectance information is not generated, 
a signal charge S4 6 corresponding to an interference component 

20 or a noise component is generated, since the noise component, 
such as ambient daylight, enters the CCD 28. A signal charge 
S47 is a charge accumulated during the electric charge 
accumulation period T u2 and is transferred to the vertical 
transfer unit 52 by the electric charge transfer signal S42 . 

25 The signal charge S47 corresponds only to reflectance correction 
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information, which is used, for correcting an error generated 
in the reflectance information due to the noise component, and 
is related, to the electric charge accumulation period. T u2 . 

In Step 120, it is determined whether one field period 
has elapsed since the beginning of the reflectance correction 

information sensing operation, i.e., whether a new vertical 

synchronizing signal has been output. When one field period 
has passed, the process goes to Step 121 in which the signal 
charge S46 of the reflectance correction information is output 
from the CCD 28. The signal charge S47 is temporarily stored 
in the image memory 34 in Step 122. 

In Step 123, a calculation process of the distance 

measurement (D) data is performed using the distance information, 
the distance correction information , the reflectance information 
and the reflectance correction information, which are obtained 
in Steps 103 through 122. The D data is output in Step 124, 

and the sensing operation ends . Conversely , when it is 
determined in Step 102 that the V mode is selected, the distance 

measuring light beam control is turned OFF in Step 125, and a 
normal photographing operation (i.e. , CCD video control) using 
all photo-diodes Slai, 51a 2 of the CCD 28 is turned ON. Then, 

the sensing operation ends. 

With reference to Figs. 7 through 10, the contents of 
the calculation executed in Step 123 is described below. 

It is supposed that the measurement subject of reflectance 
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R is illuminated and an image of the measurement subject is formed 
on the CCD 28 while considering that the measurement subject 
to be a two-dimensional light source. At this time, an output 
Sn, which is obtained by integrating an electric charge generated 
in a photo-diode for an electric charge accumulation period "t" , 
is indicated as follows: 

Sn = k-R-I-t ... (2) 

wherein "k" is a proportional coefficient, which is varied in 
accordance with an F-number and a magnification of the 
photographing lens . 

When the measurement subject is illuminated by light 
output from a light source, such as an infrared laser source, 
the luminance I is obtained by combining a luminance I s , due 

to the light source and a luminance I B due to the ambient light, 
which is indicated as follows: 

I = Is + I B ... (3) 

As shown in Fig . 7 , it is supposed that the electric charge 
accumulation period is T u;L , the pulse width of the distance 
measuring light beam S3 is T S/ a pulse width of the signal charge 
S5 or S12 of the distance information is T D , and the electric 
charge accumulation period is repeated N times for one field 
period. An output SMi 0 of the CCD is: 
SM 10 = I(k R(I s -T D 4- I B Tui)) 

= k-N-R(I s T D + I B -T UX ) ...(4) 
wherein the pulse width T D is indicated as follows: 
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T D = 5-t 

= 2r/C . . . (5) 

As shown in Fig. 9, when the electric charge accumulation 
period T u2 is greater than the pulse width T s , such that the electric 
5 charge accumulation period T u2 is large enough to receive the 
whole of the reflected light beam, an output SM 20 of the CCD is: 

SM 20 = S(k-R(I s -T s + I B -T U2 )> 

= k-N-R(I s -T s + Ib-T u2 ) ...(6) 
As shown in Pig. 8, when the light beam is turned OFF 

10 to carry out a pulse-shaped electric charge accumulation, having 

a same width as that of Fig. 7, an output SMu of the CCD is: 
SMn = £ ( k - R * I B • Ttri ) 

= k-N-R-I B -Tt,i . . . <7) 

Similarly, an output Sn of the CCD, which is obtained when an 
15 electric charge accumulation shown in Fig. 10 is performed, is 
SM 2i = E(k*R-I B -T u2 ) 

= k-N-R-I B -T u2 ... (8) 

Based on the formulas (4) , (6) , (7) and (8) , a following 
formula is obtained : 
20 S D = (SM 10 - SMu)/(SM 20 - SM 21 ) 

= T D /T S ... (9) 

As described above, the distance measuring light beam 
S3 and the reflected light beam S4 contain noise, such as ambient 
daylight (i.e. , a luminance I B due to ambient daylight) . T D /T S 
25 included in the formula (9) indicates that an amount of the 
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reflected light; beam S4 from the measurement: subject, when the 
distance measuring light beam S3 is radiated, is normalized by 
an amount of the distance measuring light beam S3, and is equal 
to a ratio of a value in which the noise component (SMn) 
5 (corresponding to the electric charge S2 6 shown in Fig. 8) is 
subtracted from the amount of the distance measuring light beam 
S3 (SMio) (corresponding to the signal charge Sll shown in Fig. 
7) , to a value in which the noise component (SM 2 i) (corresponding 

to the electric charge S47 shown in Fig. 10) is subtracted from 
10 an amount of the reflected light beam S4 (SM 2 o) (corresponding 

to the signal charge S39 shown in Fig. 9) . 

SMio , SM 1X/ SM 20 and SM 2 i included in the formula (9) are 

stored as the distance information, the distance correction 

information, the reflectance information and the reflectance 
15 correction information , in Steps 107, 112 , 117 and 122, 

respectively. Therefore, based on the information, T D /T S is 

obtained. Since the pulse width T s is known T the distance r is 

obtained from formula (5) and T D /T S . 

Thus, based on the formulas (5) and (9), the distances r from 
20 the camera body to each point on the surface of the measurement 
subject is corrected, so that an accuracy of a distance sensing 
is improved . 

With reference to Fig. 6 and Fig. 12 through Fig. 14, 
a problem that occurs when a CCD for sensing a high definition 
25 image, in which the number of pixels exceeds a mega pixel, is 



32 



used for a distance information sensing operation is explained 
in the following. 

Each of the vertical transfer electrodes in the CCD 
circuit has a stray capacitance C P , respectively. The stray 
5 capacitance C p is schematically shown in Fig. 6. A total stray 
capacitance for a group of tlie vertical transfer electrodes tliat 
are indicated with a same reference number is the result of a 
sum of the each stray capacitance C P of the electrodes in the 
group. Fig. 12 is a diagram of equivalent circuit for a group 

10 of electrodes indicated with, a same reference number. C is the 
total stray capacitance of the electrodes of which reference 
numbers are identical and R is a total resistance of the same. 
A in and A out are input and output signals of the equivalent circuit. 

In Fig. 13, an input signal A in of rectangular pulse, 

15 which is input to the equivalent circuit, and an output signal 

Aout/ which is output from the equivalent circuit in response 

to the input signal A in , are shown. Each of the signals shown 
in the figure is regularized by the maximum value of each. When 
the input signal A in of the rectangular pulse is input to the 
20 CCD circuit, the rise and fall of the output signal A out , which 
emerge as an applied voltage to the vertical transfer electrodes , 

is deformed by the total stray capacitance C and the total 
resistance R of the circuit. The deformation of the output pulse 
or output signal A out is characterized by a time constant ti (= 
25 CR) of the circuit. If the number of pixels (photo-diodes) in 
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the CCD is increased, to obtain a high definition image, the 
number of vertical transfer electrodes inevitably increases , 
thus an amount of the total stray capacitance C (sum of C P ) 
increases. Consequently, the time constant t x is increased and 

5 the rise time and the fall time of the output signal A out are 
extended . 

For example, when all o£ the photo-diodes Slai, 51a 2 in 
the CCD are used in the distance information sensing operation 
under the condition in which the amount of the total stray 

10 capacitance C and resistance R for the circuit that comprises 
all the vertical transfer electrodes 52a> x , 52a 2 of the CCD, are 
respectively 3nF (3,000pF) and 50Q, the time constant tx of the 
circuit becomes 150ns. However, when only the photo-diodes 51ai 
are used in the distance information sensing operation, amounts 

15 of the total stray capacitance C and resistance R are respectively 
reduced to 750pF and 70Q, since the photo-diodes 51ai, as shown 
in Fig. 5, are provided on every fourth line of the CCD and the 
number of the horizontal lines used in the distance information 
sensing operation is thinned out to one fourth of the entire 

20 horizontal lines of the CCD, that is, the one fourth of the entire 

electrodes 52ai and 52a 2 are used. Consequently , the time 
constant t x is reduced to 52.5ns. Fig. 14, as well as Fig. 7, 
is a timing chart of the distance information sensing operation. 
However, Fig. 14 shows timing of the electric charge transfer 
25 signal when the time constant ti is 150ns and 52 . 5ns . The electric 
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charge transfer signal S61, shown in a solid line, corresponds 
to the case in which the photo-diodes 51ai are only used in the 
distance information sensing operation and the time constant 

ti is 52.5ns. On the other hand, the electric charge transfer 
5 signal S62 , shown in a broken line , is an electric charge transfer 
signal when the entire photo-diodes 51ai, 51a2 are used and the 
time constant ti is 150ns. Furthermore, the signal charge S63 
shown in a solid line and the signal charge S64 shown in a broken 
line, which are transferred to the vertical transfer unit 52, 
10 correspond to the electric charge transfer signal S61 and S62, 
v9 respectively. 

4j In the present embodiment, a transmission of a signal 

;L charge to the vertical transfer unit 52 from the photo-diodes 

■™ 51ai or 51a 2 begins with the rise of the electric charge transfer 

Q 15 signal and ends with the fall of the same . The fall of the electric 

charge transfer signal S61 declines more rapidly than that of 
the electric charge transfer signal S62. Therefore less of the 
signal charge due to the ambient daylight is transferred to the 

vertical transfer unit 52 when the transmission is executed 

20 by the electric transfer signal S61 instead of the electric 
transfer signal S62 . A decrease in the amount of signal charge 
due to the ambient daylight is indicated with a hatched portion 
S65. Consequently, as for the signal charge transferred to the 
vertical transfer unit 52, a signal charge component S66, which 

25 corresponds to the distance information, relatively increases 



while the signal charge component corresponding to the ambient 
daylight or noise decreases. Thus the noise component included 
in the distance information decreases and the accuracy of the 

distance information sensing operation improves. Further, as 

the time for transporting the signal charge from the photo-diodes 
to the vertical transfer unit decreases, the number of times 
for integrating the signal charge during one field period can 
be increased as to obtain a higher level of the signal output. 

As described above, according to the first embodiment, 

even though a high definition CCD is used, an optical shutter 
need not be provided since an output sufficient to acquire distance 
information to the measurement subject is obtainable, thus the 
three-dimensional image capturing apparatus can be miniaturized 
and manufactured at a low cost. 

Further, according to the first embodiment, the distance 
information , which is three-dimensional image data regarding 
the topography of the measurement subject, is detected and 
accumulated concurrently without a need for scanning the distance 
measuring light beam over the measurement subject. Accordingly, 

a time over which the three-dimensional image of the measurement 

subject is obtained can be drastically shortened. 

Note that, in the first embodiment, an influence derived 
from noise, such as ambient daylight, is removed from the distance 
information of the measurement subject . Nevertheless, in a case 
where the influence can be neglected, the values of the signal 



charge regarding the influence (i.e. , Sn and S21) can be omitted 
from formula (9)- Thus, a correction regarding only the 
reflectance of the surface of the measurement subject is carried 
out . 

5 Further, in the first embodiment, although the 

accumulation of signal charge is performed for one field period 
in Steps 105, 110, 115 and 12 0, respectively, the accumulation 
may be carried out for a plurality of field periods . 

Furthermore, in the first embodiment, the photo-diodes 

10 51ai, which are used for detecting the distance information, 
are arranged at intervals of every fourth horizontal line with 
three horizontal lines of photo-diodes 51a 2 in between, however, 
the photo-diodes 51a x can also be arranged in the horizontal 
lines of the CCD at intervals with a predetermined number of 

15 horizontal lines of photo-diodes 51a 2 in between. Further, a 

combination of the above arrangements may be applied. 

With reference to Figs. 15 through Fig. 22, a second 
embodiment is described in the following . Note that a mechanical 
construction and an electrical construction are similar to those 
20 of the first embodiment, so only constructions that are different 
from those of the first embodiment are explained. 

Fig. 15 is a perspective view of a camera type 
three-dimensional image capturing device of the second 
embodiment of the present invention . 
25 In the second embodiment, the distance-measurement (D) 
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mode is further separated into normal mode (Dn mode: first 
distance information sensing means) , a first high-speed mode 
(Dhlmode: second distance information sensing means ) and a second 
high-speed mode (Dh2 mode: third distance information sensing 

5 means) . As a result, V/D mode switch 18' has four selective 

positions corresponding to each of the above three modes and 
V mode. The details of the Dn mode, Dhl mode and Dh2 mode are 

given later . 

In the second embodiment, the CCD 28, for example, is 
10 composed of photo-diodes 51ax r Slag and 51a 3 , which are 
electrically separated into three groups. Fig. 16 shows a plan 
view of a disposition of the photo-diodes 51ai, 51a 2 , 51a 3 and 
the vertical transfer unit 52 , which are provided in the CCD 
28 . 

15 Similar to the first embodiment, the photo-diodes 51ai, 

51a 2 , 51a 3 and the vertical transfer unit 52 are disposed along 
a surface of the n-type substrate 53 (refer Fig. 6) . The 
photo-diodes 51ai , 51a 2 and51a 3 are arranged in a matrix , although 
in the figure only one vertical line or column of the photo-diodes 

20 is shown. The photo-diodes are downwardly arranged in an order 

of 51ai, 51a 2 , 51a 2 , 51a 3 , 51a 2 , 51a 2 and they are repeatedly 
arranged in this order. 

The vertical transfer unit 52 is disposed beside each 
vertical column of photo-diodes . The vertical transfer unit 
25 52 has four vertical transfer electrodes for each photo-diode. 
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Namely , the vertical transfer unit 52 beside trie photo-diodes 
51ai has vertical transfer electrodes 52a x , 52b, 52c and 52d. 
Similarly , the vertical transfer unit 52 beside the photo-diodes 

51a 2 and 51a 3 has vertical transfer electrodes 52a 2 , 52fe, 52c, 

5 52d and vertical transfer electrodes 52a 3 , 52b, 52c, 52d, 
respectively. Vertical transfer electrodes indicated with the 

same reference number are electrically connected together in 
the circuit and a voltage signal can be independently applied 

to each group of electrodes that are indicated with the same 

10 reference number. Signal charges accumulated in a photo-diode 
are integrated in the vertical transfer unit 52 by the same method 
described in the first embodiment and an electronic shuttering 
operation is performed. 

In the second embodiment, the photo-diodes of the CCD 

15 are separated into three groups of the photo-diodes 51ai, 51a 2 
and 51a 3 . This separation is for sensing three-dimensional 
distance information of a moving subject. When a subject is 
moving, a detecting period for sensing distance information needs 
to be shortened. As described latter, this shortening is 

20 achieved by using 1/N (e.g. N=l,2,3) horizontal lines of 
photo-diodes of the CCD in the sensing operation of distance 
information. In the second embodiment , as mentioned above, D 
mode has three selective modes, which are Dn mode, Dhl mode and 
Dh2 mode. Dn mode is a mode that detects distance information 

25 of the measurement subject when the subject can be regarded as 
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stationary during the period o£ sensing the distance information, 

and it uses all three groups of the photo-diodes , 51a.i , 51a 2 and 
51a 3 , for detecting the distance information. Namely, all 
horizontal lines comprising photo-diodes 51ai, 51a2 or 51a 3 are 
effective horizontal lines . Dhl mode and Dh2 mode are modes 
to detect distance information of the subject when the subject 
is moving, Dhl mode uses two groups of the photo-diodes, 51ai 
and 51a 3/ for sensing the distance information and Dh2 mode uses 
one group of the photo-diodes, 51ai, for the same. Namely, in 
Dhl mode, horizontal lines comprising photo-diodes 51ai or 51a 3 
are effective horizontal lines, and in Dh2 mode, horizontal 
lines comprising photo-diodes 51ai are the effective horizontal 
lines . Dh2 mode is for sensing the distance information of a 
fast moving subject while Dhl mode is for a relatively slower 
moving subject. Namely, each of Dn mode, Dhl mode and Dh2 mode 
corresponds to distance information sensing operations which 
are carried out with the photo-diodes of the CCD thinned out 
to 1/1, 1/3 and 1/6 of the horizontal lines in the CCD, 
respectively . 

Fig. 17A to Fig. 17C are a flow chart of the distance 
information sensing operation and image information sensing 
operation in the second embodiment . 

When it is determined at step 201 that the release switch 
15 is fully depressed, Step 202 is executed to determine which 

of the video (V) mode or distance-measurement (D) mode is selected. 
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A change between V mode and D mode is carried out by manually 
operating the V/D mode switch 18' . When the V/D mode switch 
18' is set to one of the Dn mode, Dhl mode or Dh2 mode, it is 
determined as D mode . 

When it is determined in Step 2 02 tliat D mode is selected, 
in Step 203 through Step 207, it is then determined which of 
the D modes is selected, Dn mode, Dhl mode or Dh2 mode, and 
preparations for a selected mode are carried out. Namely, in 
Step 203, it is determined whether a selected mode is Dn mode. 
When Dn mode is selected, in Step 204 apreparation for the distance 
information sensing operation is made, so as to execute the 
operation without thinning out any of the photo-diodes in the 
CCD, or in other words, using all the photo-diodes 51ax , 51a 2 
and 51a 3 . When it is determined in Step 203 that a selected mode 
is not Dn mode , it is then determined whether Dhl mode is selected . 
If Dhl mode is selected, in Step 206, a preparation for the distance 

information sensing operation is made so as to execute the 

operation merely with the photo-diodes 51ai and 51a 3/ which 
results in the photo-diodes of the CCD being thinned out to 1/3 
of the horizontal lines of the CCD. Conversely, when it is 
determined in Step 205 that Dhl mode is not selected, apreparation 
for the distance information sensing operation is made in Step 
207, so as to execute the operation merely with the photo-diodes 
51ai, which results in the photo-diodes of the CCD being thinned 
out to 1/6 of the horizontal lines of the CCD. 
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Processes in Step 230 and Step 231 are identical to those 
of Step 12 5 and Step 12 6 in the first embodiment . Further , process 
from Step 208 through Step 229 are similar to the steps from 
Step 103 through Step 124 in the first embodiment. The process 
5 differs in that the photo-diodes used in the distance information 

sensing operation are selected according to the above selected 
mode and operations of signal charge output from the CCD 28, 
which is executed in step 211, 216, 221 and 226. 

The signal charge output operations , a vertical and 
10 horizontal transfer of the signal charge, executed in step 211, 
216, 221 and 226 are explained with reference to Fig. 18 to Fig. 
22 . 

Fig, 18 shows a disposition of the vertical transfer unit 
52, the horizontal transfer unit 55 and photo-diodes 51ai, 51a 2 
15 and 51a 3 . However, only one vertical column of the vertical 
transfer unit 52 and the photo-diodes 51ai , 51a 2 and 51a 3 are 

shown. A configuration of the vertical transfer unit and the 

photo-diodes is the same as the configuration described in Fig. 
6 and Fig. 16. The horizontal transfer unit 55 has horizontal 

20 transfer electrodes 55a and 55b, which are alternately arranged 
along a horizontal line. As described above, the signal charges 
accumulated in the photo-diodes are repeatedly transferred to 
the vertical transfer unit during one field period and thereby 
integrated. When the signal charge is transferred from the 

25 photo-diodes to the vertical transfer unit, voltage signal, an 
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electric charge transfer signal, is applied to each of the 
selected groups of the electrodes in accordance with the mode 
selected by the V/D mode switch, such as Dn mode, Dhl mode and 
Dh2 mode. Namely, the vertical transfer electrodes 52ai, 52a 2 
5 and 52a 3 are individually operated in the above electric charge 
transferring operation. To the contrary, in a vertical transfer 
operation, voltage signals applied to the vertical electrodes 

52ai, 52a 2 and 52a 3 aire synchronous at all times. Thus , in the 
following description, reference 52a is used to represent the 
m 10 vertical electrodes 52ai, 52a 2 and 52a 3 and the electrodes 52ai, 
,D 52a 2 and 52a 3 are treated as a single electrical group. Namely, 

r =H all the vertical transfer electrodes in the CCD 2 8 are separated 

^ into four groups of the electrodes, which are represented by 

^L; the reference 52a, 52b, 52c and 52d. The signal charges 

2 15 integrated in the vertical transfer unit 52 are transferred 

downwardly in sequence along the vertical transfer unit 52 by 
the voltage signals of four phase driving pulse applied to the 
vertical transfer electrodes 52a, 52b, 52c and 52d. When the 
lowermost signal charges are transferred to the horizontal 
20 transfer unit 55 where the horizontal transfer electrodes 55a 
are disposed, driving pulses are output to the horizontal transfer 
electrodes 55a and 55b, and then the signal charges are 
horizontally transferred to the left side of the diagram and 
output from the CCD in sequence . 
25 Fig. 19A, Fig. 19B and Fig. 19C show timing charts of 
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vertical transfer CCD pulses, which are the four phase driving 
pulses applied to the vertical transfer electrodes 52a, 52b , 
52c and 52d, and a horizontal transfer CCD pulse to the horizontal 
electrodes 55a. Fig. 19A, Fig. 19B and Fig. 19C correspond to 

5 the timing charts of Dn mode, Dhl mode and Dh2 mode respectively. 
An output timing of the horizontal transfer CCD pulse S50 and 
S51 is common to the above three modes and the time required 
for outputting signal charges of one line in the horizontal 
transfer* operation is constant. A transportation of a signal 

10 charge from the vertical transfer unit 52 to the horizontal 
transfer unit 55 is executed during a period T H when the horizontal 
transfer CCD pulse S50 is set to a high level. 

In Dn mode, all of the photo-diodes in the CCD 28 are 
used for the distance information sensing operation, and 

15 therefore signal charges accumulated in the distance information 
sensing operation are stored in the vertical transfer unit 52 
corresponding to every vertical transfer electrodes 52a, which 

are 4-n th (n— 1, 2, ...) electrode from the bottom. The vertical 
transfer CCD pulses S52 , S53 , S54 and S55 or the four phase driving 

20 pulses are output in turn for one period so as to transfer the 
signal charges downwardly through the vertical transfer unit, 
and when the vertical transfer CCD pulse S54 falls, one period 
of vertical transfer operation ends. With this one period of 
vertical transfer operation, signal charged stored beneath 

25 electrodes 52a and 52b in a certain horizontal line of* the CCD 



44 



28 are transferred to those of the electrodes 52a and 52b disposed 

one line below and signal charges stored in the bottom line o£ 
the horizontal line are transferred to the horizontal transfer 
unit 55, namely, beneath horizontal transfer electrodes 55a. 
5 Thus, the signal charges transferred to the horizontal transfer 
unit 55, which correspond to a set of signal charges for one 
horizontal line, are then transmitted horizontally through the 
horizontal transfer unit 55 and output from the CCD by the 
horizontal transfer CCD pulses S51 . In the same way, one period 
^ 10 of vertical transfer CCD pulses S52 , S53, S54 and S55 are output 

"Jj when the horizontal transfer signal S50 is set to high level, 

m and then the horizontal transfer singles S51 are output and each 

set of the signal charges corresponding to each of horizontal 

Q 

Cm lines in the CCD are output from the CCD sequentially. The 

ra 15 above operations are continued repeatedly until output of all 

^ the signal charges in the CCD is completed. 

In the Dhl mode, signal charges are only stored beneath 
the vertical transfer electrodes 52a x and 52a 3 of the vertical 
transfer unit 52 . Namely, signal charges are only stored beneath 

20 12 -n th (11=1,2, — ) electrodes from the bottom. Therefore three 
periods of vertical transfer CCD pulses are needed to transfer 
a signal charge to the horizontal transfer unit as described 
in Fig. 19B. Further, in Dh2 mode, signal charges are stored 
only beneath the electrodes 52a! of the vertical transfer unit, 

25 24 n th (n=l,2,--) electrodes from the bottom, therefore six 
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periods o£ vertical transfer CCD pulses are needed to transfer 
a signal charge to the horizontal transfer unit as shown in Fig. 
19C. The above signal charges transferred to the horizontal 
transfer unit by three or six periods of the vertical transfer 

5 CCD pulses are then output from the CCD by the horizontal transfer 

CCD pulses S51, in the same way as in Dn mode. 

As described in Fig. 19BandFig. 19C, inDhl or Dh2 modes, 

three or six periods of the vertical transfer CCD pulses are 
output during the horizontal transfer CCD pulse S50 in high level . 
: fS 10 Since the period of the pulse S50 is constant, the time required 

,0 for outputting one line of detected signal charges is the same 

Tl in each of the modes . However , in Dhl mode and Dh2 mode , the 

;;„ number of lines used for detecting the signal charges is thinned 

^ out to 1/3 and 1/6 lines. Namely, the number of the horizontal 

□ 15 transfer operations required in outputting all of the signal 
charges in the CCD is decreased to 1/3 or 1/6 , thus the time 
required for outputting all the signal charges detected in the 
CCD is reduced to 1/3 or 1/6. For example, when the CCD has 
1280 pixels in a horizontal line and 1024 pixels in a vertical 
20 line (CCD of SXGA) , 1024 periods of horizontal transfer CCD pulses 
S50 and S51 are required in order to output all the signal charges 
in the CCD. However, in Dhl mode and Dh2 mode, 342 periods and 
171 periods of the horizontal transfer CCD pulses are respectively 
required for carrying out the same . 
25 Fig. 20 shows timing charts of the distance measurement 
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operation (comprising the distance information sensing 
operation, distance correction information operation, 
reflectance information sensing operation and reflectance 
correction information operation) executed in each of the mode 
Dn, Dhl and Dh2 . Image signals output S71, S72 , S73 and S74 
indicate signals output from the CCD during the execution of 
the distance information sensing operation, the distance 
correction information operation, the reflectance information 
operation and reflectance correction information operation, 
respectively. A detecting period T 0 in the Dn mode corresponds 
to a frame period, which is 1/30 seconds when the NTSC standard 
is applied. Therefore, 2/15 seconds (133.3 ms) , a time period 
T 3/ is required in order to execute all of the distance 
measurement operation . In each of the sensing operations of 
the distance measurement operations, there is a period Ti in 
which signal charges accumulated in a photo-diode are repeatedly 
transferred to a vertical transfer unit so as to integrate them, 
and a period T 2 in which the signal charges integrated in the 
vertical transfer unit are output from the CCD through the 
horizontal transfer unit. It requires 3.6 ps for transmitting 
a signal charge from a photo-diode to the vertical transfer unit, 
when the width of the electric charge discharging signal SI and 
the electric charge transfer signal S9 are 2 us and 1 us 

respectively; a time period between the fall of the electric 

charge discharging signal SI and the rise of the electric charge 
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transfer signal S9 is 500 ns; and a time period between the fall 
of the electric charge transfer signal S9 and the rise of the 

next electric charge discharging signal SI is 100 ns , as shown 
in Fig . 7 for an example . Thus when signal charges are transferred 
1000 times in one field period, which corresponds to 1000 times 
integration, the period Ti becomes 3 . 6 ms . Note that the period 
T 2 , a period for outputting signal charges detected in the CCD, 
is 1/60 seconds (approximately 16 . 7 ms) , which is one field period 
in NTSC standard. 

On the other hand, in Dhl and Dh2 modes, one field period 
is shorter than that of NTSC standard. Although, in Dhl and 
Dh2 modes , the period T x for 1000 times integrations of signal 
charges is the same as that of Dn mode , periods T 2 ' andT 2 ", periods 
for outputting signal charges detected in the CCD, are 1/3 and 
1/6 of the period T 2 respectively, since the horizontal lines 
applied in the distance measurement operation are thinned out 
to 1/3 and 1/6 of all the horizontal lines in the CCD, which 
are used in Dn mode. Namely, the period T 2 ' becomes 5.6 ms and 
the period T 2 " becomes 2.8 ms approximately. Further, when a 

period from the end of the integration in the vertical transfer 
unit through the beginning of the vertical transfer operation 
and a period from the end of the vertical and horizontal transfer 
operations through the beginning of the signal charges 
integration prosecuted in the next sensing operations are, for 
example, 1 us, the periods T 0 ' and T 0 " in the Dhl and Dh2 modes 
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become 9 . 2 ms and 6.4ms, respectively . Therefore , time periods 
T 3 ' and T 3 " required for prosecuting all of the distance 
measurement operations in Dhl mode and Dh2 mode become 36.8 ms 

and 25.6 ms respectively. Consequently, a time required for 

the distance measurement operation is drastically shortened when 
the horizontal lines applied for the operation are thinned out, 
and this enables the three— dimensional image capturing- device 
to detect the distance information of a fast moving subject. 

As described above, according to the second embodiment, 
the advantages of the first embodiment are also obtained. 

Further, in the second embodiment, since a plurality o£ distance 

measurement modes, in which the number of horizontal lines 
applied in the distance measurement operations differs from one 
another, are prepared, distance information is sensed with the 

mode appropriate for subject speed, and precise distance 
information may be obtained. 

Note that, in the second embodiment , similar to the first 
embodiment, an influence derived from noise, such as ambient 
daylight, is removed from the distance information of the 
measurement subject . Nevertheless , in a case where the influence 
can be neglected, a correction regarding only the reflectance 
of the surface of the measurement subject is carried out. 

Further, in the second embodiment, although the 
accumulation of signal charge is performed for one field period 
in Steps 210, 215, 220 and 225, respectively, the accumulation 



may fee carried out for a plurality of field, periods . 

In the second embodiment, although the horizontal lines 
Of the photo-diodes are separated into three electric groups, 
they may also be separated into two electric groups or four or 
5 more electric groups. Further, in each distance measurement 

mode of the second embodiment, the horizontal lines used in each 
corresponding distance measurement operation are disposed every 
n-1 lines (where n=l , 2 and 3) , however, horizontal lines applied 
in a distance measurement operation need not to be disposed 

10 regularly for every predetermined line . For example , a distance 
measurement operation may be operated merely with photo-diodes 
51a2 or merely with photo-diodes 51ai and 51a2- 

Although the embodiments of the present invention have 
been described herein with reference to the accompanying drawings , 

15 obviously many modifications and changes may be made by those 
skilled in this art without departing from the scope of the 
invention . 

The present disclosure relates to subject matter 
contained in Japanese Patent Application Nos . 11-162889 and 

20 11-176968 (filed on June 9 and June 23, 1999, respectively) which 
axe expressly Incorporated herein, by reference, in their 
entireties . 
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CLAIMS 

1 . A three-dimensional image capturing device, comprising: 

a light source that radiates a distance measuring light 
beam irradiating a measurement subject, said measurement subject 

5 reflecting said distance measuring light beam to generate a 

reflected light beam; 

a plurality of first photoelectric conversion elements 
and second photoelectric conversion elements, arranged in a 
predetermined direction , that receive said reflected light beam , 
10 so that electric charge corresponding to an amount of said received 
reflected light beam is accumulated in each of said first and 
second photoelectric conversion elements; 

a first electric charge holding unit disposed adjacent 
to each of said first photoelectric conversion elements ; 
15 a second electric charge holding unit disposed adjacent 

to each of said second photoelectric conversion elements ; 

a first electric charge transfer processor that transfers 
first electric charge accumulated in said first photoelectric 
conversion elements to said first electric charge holding unit 

20 with first electrodes connected only to said first electric 

charge holding unit; 

a second electric charge transfer processor that 
transfers second electric charge accumulated in said second 
photoelectric conversion elements to said second electric charge 
25 holding unit with second electrodes connected only to said 



51 



second electric charge holding unit; and 

an electric charge integrating processor that drives 
said first electric charge transfer processor repeatedly, so 
that said first electric charge relating to distance information 
of said measurement subject is integrated in said first electric 
charge holding unit. 

2. A device according to claim 1, comprising: 

a first electric charge discharging processor that 
discharges unwanted charge accumulated in each of said first 
photoelectric conversion elements, so that an accumulating 
operation of electric charge is started in each of said first 
photoelectric conversion elements ; 

a second electric charge discharging processor that 
discharges unwanted charge accumulated in each of said second 

photoelectric conversion elements, so that an accumulating 
operation of electric charge is started in each of said second 
photoelectric conversion elements ; and 

wherein said electric charge integrating processor is 
operated by driving said first electric charge discharging 
processor and said first electric charge transfer processor 
alternately . 

3- A device according to claim 2, wherein said first 

photoelectric conversion elements and said second photoelectric 
conversion elements are formed on a substrate, and said first 

electric charge discharging processor discharges said unwanted 
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charge to said substrate. 

4. A device according to claim 1, wherein said first and 

second electric charge holding units are provided in a vertical 
transfer unit that outputs said electric charge from said 
5 three-dimensional image capturing device. 

5 . A device according to claim 1 , wherein said first 

photoelectric conversion elements are arranged in a 
predetermined direction with a predetermined number of said 
Q second photoelectric conversion elements in between. 

;0 10 6. A device according to claim 2 , wherein said first electric 

pi charge discharging processor outputs an electric charge 

«E discharging signal to discharge said unwanted charge, and said 

□ first electric charge holding processor outputs a first electric 

H charge transfer signal to transfer said first electric charge 

:^ 15 to said first electric charge holding unit, and said second 

electric charge holding processor outputs a second electric 
charge transfer signal to transfer said second electric charge 
to said second electric charge holding unit, said electric charge 
discharging signal and said first and second electric charge 
20 transfer signals being pulse signals. 

7 . A device according to claim 6 , wherein said first electric 

charge, corresponding to at least distance information of said 
measurement subject, accumulates in said first photoelectric 
conversion elements until a receiving of said reflected light 
25 beam by said first photoelectric conversion elements ends. 
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8 . A device according to claim 7 , wherein said first electric 

charge, corresponding to at least distance information of said 

measurement subject, starts to accumulate in said, first 
photoelectric conversion elements when an output of said electric 
charge discharging signal ends . 

9. A device according to claim 6, wherein said light source 
radiates a pulsed beam of said distance measuring light beam 
during a first accumulating period, which is from an output of 
said electric charge discharging signal to an output of said 
first electric charge transfer signal, and said first electric 
charge corresponding to distance information regarding said 
measurement subject is integrated in said first electric charge 
holding unit . 

10. A device according to claim 1, comprising: 

a radiating operation control processor that prohibits 
a radiation o£ said distance measuring light beam from being 
radiated from said light source; and 

an image information sensing processor that drives said 
first and second electric charge discharging processors and said 
first and second electric charge transfer processors, on 
condition that said radiation of said distance measuring light 
beam prohibited by said radiating operation control processor, 
so that said first and second electric charge corresponding to 
an image information of said measurement subject is transferred 
to said first and second electric charge holding units 
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respectively . 

11 . A three-dimensional image capturing device, comprising: 

a light source that radiates light irradiating a 
measurement subject; 

5 a plurality of optical sensors that generate electric 

charge corresponding to an amount of light receivedby said optical 
sensors and is separated into predetermined groups ; 

electric charge transfer electrodes that are applied to 
each of said optical sensors in order to transport said electric 
10 charge generated in said optical sensors to the outside of said 
optical sensors ; 

an electric charge transfer unit that holds said electric 
charge transferred from said optical sensors by said electric 
charge transfer electrodes and transports said electric charge 
15 held in said electric charge transfer unit ; 

an electric charge transfer electrode control processor 
that can control each said group of said electric charge transfer 
electrodes independently; and 

an electric charge accumulating processor that 
20 repeatedly drives said electric charge transfer electrode 

control processor and repeatedly transfers electric charge 
generated in certain said groups of said optical sensors, so 
that transferred electric charge accumulates in said electric 
charge transfer unit. 
25 12 . A three-dimensional image capturing device, comprising: 



a light source that radiates a distance measuring light 

beam irradiating a measurement subject, said measurement subject 
reflecting said distance measuring light beam to generate a 
reflected light beam; 
5 a plurality of photoelectric conversion elements that 

receive said reflected light beam, so that electric charge 
corresponding to an amount of said received reflected light beam 
is accumulated in each of saidphotoelectric conversion elements , 
Cf and is disposed in a matrix arrangement; 

l fl 10 a vertical transfer unit that is disposed along each 

U vertical line of saidphotoelectric conversion elements, so that 

,p said electric charge accumulated in said photoelectric 

5 conversion elements is transferred in a vertical direction; 

;rf a horizontal transfer unit that is disposed nearby one 

15 end of said vertical transfer unit and in parallel with 
horizontal lines of saidphotoelectric conversion elements, so 

that said electric charge is transferred in a horizontal 
direction ; 

a electric charge transfer processor that transfers 
20 electric charge accumulated only in photoelectric conversion 
elements comprising effective horizontal lines, which are 
disposed every predetermined number of said horizontal lines; 

a electric charge integrating processor that drives said 
electric charge transfer processor repeatedly and integrates 
25 said electric charge accumulated in said photoelectric 
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conversion elements comprising said effective horizontal lines, 
in said vertical transfer unit; and 

a transfer operation control processor that controls said, 
horizontal transfer unit and said vertical transfer unit, so 
5 that said horizontal transfer unit is driven only when said 
electric charge corresponding to said effective horizontal lines 
is transferred to said horizontal transfer unit. 

13. A device according to claim 12, wherein said horizontal 
lines are separated into a plurality of groups and said effective 

10 horizontal lines are composed of one of said groups or combination 
of said groups . 

14. A device according to claim 13, wherein said horizontal 
lines are separated into first, second and third groups, and 
an arrangement of said first, second and third groups in vertical 

15 direction is a repetition of a "first, second, second, third, 
second, second" order. 

15. A device according to claim 12, comprising an electric 

charge discharging processor that starts accumulation of said 
electric charge in said photoelectric conversion elements by 

20 discharging unwanted charge accumulated in said photoelectric 
conversion elements, and wherein said electric charge 
integrating processor is operated by driving said electric 
charge discharging processor and said electric charge transfer 
processor alternatively . 

25 16. A device according to claim 15 , wherein saidphotoelectric 
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conversion elements are formed on a substrate, and said electric 

charge discharging processor discharges said unwanted charge 
to said substrate. 

17. A device according to claim 16, wherein accumulation of 

5 electric charge corresponding to at least distance information 
of said measurement subject starts in said photoelectric 
conversion elements when an output of an electric discharging 
signal, which discharges said unwanted charge in said electric 
charge discharging processor, ends. 

10 18 . A device according to claim 17 , wherein said light source 

radiates a pulsed beam of said distance measuring light beam 
during a first accumulating period, which is from an output of 
said electric charge discharging signal to an output of said 
electric charge transfer signal, and said electric charge 

15 corresponding to distance information regarding saidmeasurement 
subject is integrated in said vertical transfer unit of said 

effective horizontal lines. 

19 . A three-dimensional image capturing device, comprising: 

a light source that radiates light irradiating a 
20 measurement sub j ect ; 

a plurality of photoelectric conversion elements that 
can accumulate electric charge corresponding to an amount of 
light received by said photoelectric conversion elements , and 
disposed in a matrix arrangement; 
25 a electric charge transfer control processor that 
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controls an electric transfer operation, which outputs electric 
charge accumulated in said photoelectric conversion elements 

to the outside of said photoelectric conversion elements; 

a distance calculating processor that calculates a 
5 distance, from said photoelectric conversion element to said 

measurement subject, from an amount of electric charge 
accumulated in said photoelectric conversion elements from 

light reflected by said measurement subject and received in said 
photoelectric conversion elements ; 

10 a first distance measuring processor that drives said 

electric charge transfer control processor in order to output 
electric charge accumulated in all said photoelectric conversion 
elements , and calculates distances corresponding to all said 
photoelectric conversion elements by means of said distance 

15 calculating processor; and 

a second distance measuring processor that drives said 
electric charge transfer control processor in order to output 
electric charge accumulated in selected photoelectric 
conversion elements , and calculates distances corresponding 

20 to said selected photoelectric conversion elements by means of 
said distance calculating processor. 

20. A device according to claim 19, comprising a distance 

measurement selecting processor that selects either said first 
or second distance measuring processor and drives the selected 
25 processor . 
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21. A device according to claim 20, wherein said first 

distance measuring processor is for measuring a stationary 

measurement subject and said second distance measuring processor 

is for measuring a moving measurement subject. 

5 22. A device according to claim 2 1 , wherein saidpho toelectric 
conversion elements comprise first photoelectric conversion 
elements and second photoelectric conversion elements a number 
of said second photoelectric conversion elements being less than 
that of said first photoelectric conversion elements, and said 

10 second distance measuring processor comprising; 

a first high speed mode that drives said electric charge 
transfer control processor so as to output electric charge from 
said first photoelectric conversion elements and calculates said 
distance corresponding to said first photoelectric conversion 

15 elements ; 

a second high speed mode that drives said electric charge 
transfer control processor so as to output electric charge from 
said second photoelectric conversion elements and calculates 
said distance corresponding to said second photoelectric 
20 conversion elements; and wherein 

said distance is calculated with said first high speed 
mode when said measurement subject is moving at a relatively 
slow speed , and with said second high speed mode when said 

measurement subject is moving at a relatively fast speed. 

25 
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THREE-DIMENSIONAL IMAGE CAPTURING DEVICE 

ABSTRACT OF THE DISCLOSURE 

A three-dimensional image capturing device comprises an 
imaging device , such, as a CCD , having a plurality of photo-diodes , 
a vertical transfer unit and a substrate. The plurality of 
photo-diodes is separated into a plurality of groups and each 

of the groups can be controlled independently. A distance 

measuring light beam having a predetermined pulse width is 
radiated to a measurement subject and a reflected light beam, 
generatedby the measurement subject due to the distance measuring 

light beam, is sensed by the photo-diodes, so that a distance 

information sensing operation which detects distance 
information of the measurement subject is executed. In the 

distance information sensing operation, only predetermined 
groups of the photo-diodes are used for sensing the distance 
information, while in an image information sensing operation, 
which detects an image of the measurement subject, all 
photo-diodes in the CCD are used. 
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FIG. 17A 
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FIG. 17B 
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Declaration and Power of Attorney For Utility or Design Patent Application 



Japanese Language Declaration 



Tli:3E«StLTi^«^)fciii:, 



As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated 

below next to my name. 

1 believe I am the original, first and sole inventor (if only one name is 
listed below) or an original, first and joint inventor (if plural names 
are listed below) of the subject matter which is claimed and for 

which a patent is sought on the invention entitled 

THREE-DIMENSIONAL IMAGE CAPTURING DEVICE 



□ 



the specification of which 

(check one) 

£3 is attached hereto. 



□ was filed on . 



Application No.. 



and was amended on 



(if applicable) 

I hereby state that I have reviewed and understand the contents of 

the above identified specification, including the claims, as amended 

by any amendment referred to above. 

1 acknowledge the duty to disclose information which is material to 
the examination of this application in accordance with Title 37, Code 
of Federal Regulations, §1.56. 

I hereby claim foreign priority benefits under Title 35, United States 

Code §1 19(a-d) or §365(b) of any foreign application(s) for patent 
or inventor's certificate, or §365(a) of any PCT international 
application which designated at least one country other than the 
United States of America, listed below and have also identified 
below, by checking the "No" box, any foreign application for patent 
or inventor's certificate, or of any PCT international application having 
a filing date before that of the application on which priority is claimed: 



Prior foreign applications 
Pll-162889 


Japan 


09 /June/1999 


Priority claimed 

a □ 


(Number) 
Pll-176968 


(Country) 

(tsifi) 

Japan 


(Day/Month/Vear Filed) 
23/June/1999 


Yes Wo 

a □ 


(Number) 


(Country) 
(SI*) 


(Day/Month/Year Filed) 


Yes No 

& 0 & u 

□ □ 


(Number) 


(Country) 

(E!£) 


(Day/Month/Year Filed) 
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Yes No 
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□ Additional foreign application numbers are listed on a 
supplemental priority sheet attached hereto. 

I hereby claim the benefit under Title 35, United States Code §11 9(e) 
of any United States provisional appiication(s) listed below. 



(Number) 


(Day/Month/Year Filed) 






(Number) 


{Day/Month/Year Filed) 


(§5) 





(Number) (Day/Mont h/Year Fifed) 



m 



□ Additional provisional application numbers are listed on a 
supplemental priority sheet attached hereto, 

I hereby claim the benefit under Title 35, United States Code §120 
of any United States application(s), or §365(c) of any PCT 
international application designating the United States of America, 
listed below and, insofar as the subject matter of each of the claims 

of this application is not disclosed in the prior United States or PCT 
international application in the manner provided by the first 
paragraph of Title 35, United States Code §112,1 acknowledge the 
duty to disclose information which is material to patentability as 

defined in Title 37, Code of Federal Regulations §1 .56 which became 

available between the filing date of the prior application and the 
national or PCT international filing date of this application. 



(Application No.) (Day/Month/Year Filed) (m.U) (Status) 

(&m%n) (M^B) (mm&, mm* tm&&) (patented, pending, abandoned) 



J (Application No.) (Day/Month/Year Filed) mU) (Status) 

(fflUS*) (£bE©*MB) (imffi&, mm* nmm&) (patented, pending, abandoned) 



a<o*r 1- « 1**8 *>- j: xmi? ztzziz'&^Tft'? iz$m &umx &ztm 



□ Additional U.S. or international application numbers are listed 

on a supplemental priority sheet attached hereto. 

I hereby declare that all statements made herein of my own 
knowledge are true and that all statements made on information 
and belief are believed to be true; and further that these statements 
were made with the knowledge that willful false statements and the 
like so made are punishable by fine or imprisonment, or both, under 
Section 1001 of Title 18 of the United States Code and that such 
willful false statements may jeopardize the validity of the application 
or any patent issued thereon. 

The undersigned hereby authorizes the U.S. attorney or agent 
named herein to accept and follow instructions from either his foreign 
patent agent or corporate representative, if any, as to any action to 
be taken in the Patent and Trademark Office regarding this 
application without direct communication between the U.S. attorney 
or agent and the undersigned. In the event of a change in the 

persons from whom instructions may be taken, the U.S. attorney 
or agent named herein will be so notified by the undersigned. 
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7055 

Neil F. Greenblum 
Bruce H. Bernstein 
Roger P. Glass 
James L. Rowland 
Arnold Turk 



POWER OF ATTORNEY: As a named inventor, I hereby appoint 
the attorney(s) and/or agent(s) associated with the Customer 
Number provided below to prosecute this application and 
transact all business in the Patent and Trademark Office 
connected therewith, and direct that all correspondence be 
addressed to that Customer Number: 

CUSTOMER NUMBER 7055 

The appointed attorneys presently include: 

Reg. No. 28,394 
Reg. No. 29,027 
Reg. No. 30,841 
Reg. No. 32,674 
Reg. No. 33,094 



Address: GREENBLUM & BERNSTEIN, P.L.C. 

1941 ROLAND CLARKE PLACE 
RESTON, VA 20191 



Uk$c*B3feKSJE; : (&ffcte JctfUBS^) Direct Telephone Calls to: {name and telephone number) 



GREENBLUM & BERNSTEIN, P.L.C. 

(703)716-1191 



o 


Full name of sole or first inventor 
Nobuhiro TANI 




inventor's signature Date 




Residence 
Tokyo, Japan 


mm 


Citizenship 
Japan 




Post Office Address 

c/o ASAHI KOGAKU KOGYO KABUSHIKI KAISHA 




36-9 , Maenocho 2-chome, 
Itabashi-ku, Tokyo, Japan 




Full name of second joint inventor, if any 




Second Inventor's signature Date 


im 


Residence 


mm 


Citizenship 




Post Office Address 







{W>t^&iz\$^fim%<n&ffl^n^lz$$vx tmWtte^^ (Supply similar information and signature for third and 

&«£t>l?&£#§{&i"5 ifco) subsequent joint inventors.) 
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